On linear systems and r functions associated with Lame's equation 

and Painleve's equation VI 

Gordon Blower 

Department of Mathematics and Statistics, 
Lancaster University, Lancaster LAl 4YF, England UK 

17th November 2009 

d\ • ■ — ^ 

I ABSTRACT Painleve's transcendental differential equation Pyj may be expressed as the consis- 

Ps| I tency condition for a pair of linear differential equations with 2x2 matrix coefficients with rational 

J> I entries. By a construction due to Tracy and Widom, this linear system is associated with certain 

! kernels which give trace class operators on Hilbert space. This paper expresses such operators 

, in terms of Hankel operators of linear systems which are realised in terms of the Laurent co- 

T— I , efficients of the solutions of the differential equations. Let P{^t.ao) '■ 

L^{0,oo) L2(t,oo) be the 

I— i. orthogonal projection. For such, the Fredholm determinant T(t) = det(/ — P(t,oo)^4>) defines the r 

. function, which is here expressed in terms of the solution of a matrix Gelfand Levitan equation. 

For suitable values of the parameters, solutions of the hypergeometric equation give a linear system 
with similar properties. For meromorphic transfer functions (j) that have poles on an arithmetic 
progression, the corresponding Hankel operator has a simple form with respect to an exponential 
basis in L^(0, oo); so det(I — F^P^^^c^)) can be expressed as a series of finite determinants. This 
^ ■ applies to elliptic functions of the second kind, such as satisfy Lame's equation with 1=1. 

0^ , Keyword: random matrices, Tracy- Widom operators 

cn ■ MSC2000 classification 47B35 

cn ; 

^ . 1. Introduction 

Q>^ ' Tracy and Widom [29] observed that many important kernels in random matrix theory arise 

' from solutions of linear differential equations with rational coefficients. In particular, the classical 

.J^ I systems of orthogonal polynomials can be expressed in such terms. In this paper, we extend the 

X : scope of their investigation by analysing kernels associated with Lame's equation and Painleve's 

5t , equation VI. As these differential equations have solutions which may be expressed in terms of 

elliptic functions, we begin by reviewing and extending the definitions from [29]. 

Let P{x, y) be an irreducible complex polynomial, and n the degree of P{x, y) as a polynomial 
in y. Then we introduce the curve £ = {{X, fi) £ C : P{X, n) = 0}, and observe that £ U {(oo, oo)} 
gives a compact Riemann surface which is the n-sheeted branched cover of Riemann's sphere P^. 
Let K be splitting field of P{x,y) over C{x), so we can regard K as the space of functions of 
rational character on £. Let g be the genus of £, and introduce the Jacobi variety J of £, which is 
the quotient of by some lattice L in C^. 

Definition. By a Tracy-Widom system [29] we mean a differential equation 
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where a, 7 belong to K or more generally are locally rational functions on J. Then for solutions 
with f,g G L°°((0, 00); R), we introduce an integrable operator on L^(0, 00) by the kernel 

K(,^^)^[(!!m^im-i (.^,;.,,eR) (1.2, 

X y 

The kernel K compresses to give an integral operator Ks on L'^{S;dx) for any subinterval S 
of (0, 00) and it is important to identify those Ks such that Ks is of trace class and < Ks < I- 
In such cases, the Predholm determinant det(J + XKs) is defined and Ks is associated with a 
determinantal random point field on S. In particular, det(7 — i^(t^oo)) gives the probability that 
there are no random points on (0, 00). 

Definition (r-function). Suppose that K : L^(0, 00) — > L^(0, 00) is a self-adjoint operator such 
that K < I, K is trace class and I — K is invertible. For a measurable subset S of (0,oo), let 
Ps ■ L'^{0, 00) — > L'^{S) be the orthogonal projection given by / /I^, where I5 is the indicator 
function of S. Then the r function is 

r(t) = det(7 - ifP[t,^)) (t>0). (1.3) 

The purpose of this paper is to take kernels that are given by certain Tracy- Widom systems, 
and show how to express the corresponding r in terms of the solution of a Gelfand-Levitan integral 
equation. Our technique involves linear systems, and extends ideas developed in [6], and leads to 
a solution of the integral equation in terms of the linear system. 

Let i? be a complex separable Hilbert spaces, known as the state space, and let (e~*'^)t>o a 
bounded Co-semigroup of linear operators on iJ; so that T>{A) is a dense linear subspace of H, 
and ||e-*^|| < M for alH > and some M < 00. Then let B : C ^ V{A) and C : V{A) ^ C be 
bounded linear operators, and introduce the linear system 

^ = -AX + BU (X(0) = 0), 
ax 

Y = CX (1.4) 
known as {—A, B, C). Under further conditions to be discussed below, the integral 

/■oo 

/ e-'^BCe-^'^dt (1.5) 

J X 

converges and defines a trace class operator on H. The notation suggests that is a resolvent 
operator. 

Definition (Hankel operator). For a linear system as above, we introduce the symbol (j){x) = 
Ce~^^B, which gives a bounded function : (0, 00) C; this term should not be confused 
with the different usage in [26, p 6]. Generally, for E a separable complex Hilbert space and 
(j) G -C,^((0, 00); E), let be the Hankel operator 

r^h{x)= / (t>{x + y)h{y)dy (1.6) 
Jo 
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defined on a suitable domain in L^(0, oo) into L^((0, oo); £^). 

By forming orthogonal sums of the state space and block operators, we can form sums of 
symbol functions. Likewise, by forming tensor products of state spaces and operators, we can from 
products of symbol function. Using these two basic constructions, we can form some apparently 
complicated symbol functions, starting from the basic multiplication operator A : f(t) tf{t) in 
L2(0,oo). Thus we extend the method of section 2 to a more intricate problem. 

In section 3, we consider operators related to the solution of Painleve's transcendental equation 

VI 

df^ 2\y y-l y-t)\dt) \t t-l y-t)dt 

y{y-l){y-t) / jit ^{t - \) ,5t(t-l) x 

with constants 

a = \{Q^-\)\ (5 = -\el ^ = \el 5=\{i-e^,) (i.s) 



and 



^oo = -2(^0 + ^1 + zt) - (00 + 9i+ dt). (1.9) 



Jimbo, Miwa and Ueno [15, 16] showed that the nonlinear differential equation Pyi is the compat- 
ibility condition for the pair of linear differential equations 



dX V A A - 1 X-t 
d^ -Wt 



dt X-t 



$ (1.11) 



on the punctured Riemann sphere with 2x2 complex matrices Wq, Wi,Wt depending upon t; see 
(3.8) for the entries. Using the Laurent series of <1>(A), we introduce a linear system {—A,B,C) 
that realises $ and deduce information about the Hankel operator r$. In previous papers [5,6], we 
have considered kernels that factorize as if = L^F^ where is Hilbert-Schmidt, so that K > 
and K is trace class. In the context of Pvi, we show that the prescription (1.2) gives a kernel K 
that admits a factorization K = F^crF,^, where cr is a constant signature matrix. In section 5 we 
introduce a suitable r function and express this in terms of the solution of an integral equation of 
Gelfand-Levitan type, which we can solve in terms of the linear system. A similar approach works 
for suitable solutions of Gauss's hypergeometric equation with a restricted choice of parameters, 
as we show in section 5. 

Definition (Transfer function). Given a Hilbert space E, for (f) e L^((0, oo); dt; ^) let 

e-'*^{t)dt (1.12) 



/ 

^0 



be the transfer function of (f), otherwise known as the Laplace transform, which gives an analytic 
function from {s : 3f?s > 0} into E. 

We assume that (f) is meromorphic, and that, by virtue of the Mittag-Leffler theorem, one can 
express as a series 

oo 
3 = 1 

in which we shall always assume that 5RAj > and that the e~^^^ are linearly independent in 
L^(0, oo). We wish to express various r functions in terms of the determinants 

1 



DsxT = det 



A,- + Afc- 



(1.14) 

U,k)eSxT 



where S and T are finite subsets of N of equal cardinality. In sections 6, we consider Hankel 
operators with symbols as in (1.13), and establish basic results about the expansions of det(/ — F^) 
in terms of the bases. In particular, if (Aj)|2.i forms an arithmetic progression in the plane, then 
— s+x §i'^^s ^ cardinal scries. 

In section 7, we consider the Besscl kernel, which arises in random matrix theory as the hard 
edge of the eigenvalue distribution from the Jacobi ensemble [28]. Let J,y be Bessel's function of 
the first kind of order ly, and let u{x) = \fxJv(2\fx)^ which satisfies 

We introduce (^{x) = u{e~^), and the Hankel operator with symbol (f). The transfer function ^ 
is meromorphic with poles on an arithmetic progression on the positive real axis, so we are able to 
obtain a simple expansion for r(t) = det(7 — F^P[t qq))) f'lid identify the determinants Dnxn with 
combinatorial objects. 

In section 8 we consider solutions of Lame's equation 



(^—^+i{£ + l)k'^sn{z I k)^^Hz) = X^z) (1.16) 

which we express as a differential equation on the elliptic curve = 4(X — ei)(X — 62) {X — 63). 
The solution gives rise to an elliptic function (p such that (j) has poles on a bilateral arithmetic 
procession parallel to the imaginary axis in C. Hence we can prove results concerning the Fredholm 
determinant of F<^. 

2. The r function associated with a linear system 

In this section we introduce the basic example of the linear system which we will use in sections 
3 and 5 to realise solutions of some differential equations. In [30], Tracy and Widom consider 
physical applications of the kernels Rx that we introduce her. 
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Definition (Integrable operators). Let /i, . . . ,fN,gi, ■ ■ ■ ,gN € L°°(0,oo) satisfy 

N 

5^/,(s)5,(x) = (x>0). 

Then the integral operator K on -L^(0, oo) that has kernel 

K^^LiIMEM (2.1) 
x-y 

is said to be an integrable operator; see [9]. One can show that K is bounded on L^(0, oo). 

Let T>{A) = {/ G -L2(0,oo) : tf{t) G L2(0,oc)} and for 6,c G P(^) introduce the operators: 



A 
B 
C 



V C L2(0, oo) ^ L2(o^ oo) : f{x) ^ xf{x) 



C ^ P(^) : a ^ 6a; 

P(A)^C: f^J^^f(s)c{s)ds (2.2) 
: L2(0, oo) ^ L2(0, oo) : e^/(i) = e-''*c{t)f{t) 
: L2(0, oo) ^ L2(0, oo) : EJ{t) = e-*6(t)/(s) 

Then we introduce (j){s) = Ce~'^^B and (t>{x){s) = 0(s + 2x), and the Hankel integral operator 
^4>{x) with kernel ^(s + t + 2x). Then we introduce = e~*^BCe~*'^ dt which has kernel 

6(i)c(s)e-^("+*) , 

R,^^1AJ_ {s,t>0). (2.3) 

Proposition 2.1. Suppose that c{t)/^ and 6(t)/-\/t belong to L'^{0, oo), and tiiafc c and b belong 
to L°°(0,oo). 

(i) Then r,^^^^ and are trace class operators for all x>0. 

(n) Suppose further that I + XR^ is invertible for some A G C. Tiien 

Tx{x,y) = -XCe-'-^^il + XR^r^e-y^B (2.4) 

gives the solution to the equation 

f'OO 

X(t>{x + y)+Tx{x,y) + X T^ix, z)^{z + y) dz = {0 < x < y) (2.5) 

J X 

and 

Tx{x,x) = ^logdet{I + XT^^^^). (2.6) 
(Hi) The operator R^ is an integrable operator with kernel 

Rl ^ e-^"6(t^)^^^^^£^^c(t)e-"* (2.7) 

wJiere 

Uu)= ^ ■ dt. (2.8) 
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(iv) Ifl + XRx and I — XR^ are invertible, then there exists an integrable operator Lx{X) such 



that 



I + Lx{X) = {I-X^Rl)-\ 



(2.9) 



Proof, (i) One checks that 9^; has kernel e~**e~^*c(i) and that S^; has kernel e~®*~^*6(s); hence 
©J. and Sj, are Hilbert-Schmidt operators. One verifies that their products are R^^ = 2^0|. and 
r<^^ = Q^'Bx, and hence Rx and are trace class. 

(ii) Using (i), we can check that det(/ + XRx) = det(7 + Ar,^^^^). Then one verifies the 
remainder by using Lemma 5.1(iii) of [6]. 

(iii) This result is essentially contained in lemma 2.18 of [9], but we give a proof for complete- 
ness. The kernel of R^ is 



6(s)e-"^c(u)e- 



-2tx 



b{t)c{t)e 
{s + t){u + t) 



dt 



{u,s> 0), 



(2.10) 



and one can decompose this expression by using partial fractions. By the Cauchy-Schwarz inequal- 
ity, |/x(«)P < j'^ t-^h{tfdt j'^ t-^c{tfdt, so fx is bounded. 

(iv) Furthermore, (7 — XRx)~^{I + XRx)~^ is a bounded linear operator; so by Lemma 2.8 of 
[9], there exists an integrable operator Lx such that (7 -I- Lx{X)){I — X^R^) = I. 

□ 

Given an integrable operator K on L^(a, b) such that I — K \s invertible, the authors of [9] show 
how to express {I — K)~^ as the solution of a Riemann-Hilbert problem on a bounded interval 

3. A linear system associated with Painleve's equation VI 

The Painleve equation Pyi is associated with the system 



lx 

M _ -Wt 
Itt ~ X-t 



Wi 



A- 1 ^ A 



(3.1) 

(3.2) 



where the fixed singular points are {0, 1, oo} and 



+ 9^/2 



'^1/^1/ 



(i/ = 0,l,t) 



(3.3) 



with parameters Oi, and satisfying various conditions specified in [16]. The consistency condition 
for the system (3.1) and (3.2) reduces to the identity 



1 dWn 



+ 



dWi 



+ 



1 dWt _ [Wo,Wt, 



X dt (X-l) dt (X-t) at A(A-t) (A-l)(A-i)' 



(3.4) 



which leads, after a lengthy computation given in Appendix C of [16], to the equation Pyi- 

Jimbo et al [15, 16, 17] introduced pairs of differential equations (3.1) and (3.2) such that 
(3.5) reduces to one of the Painleve equations. In the present context (3.1) are known as the 
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deformation equations and (3.4) is associated with the names of Schlesinger and Garnier [10]. 
Note that traced = if and only if JW is symmetric; also W is nilpotent if and only if JW is 

symmetric and dct{ JW) = 0. 

First we introduce a linear system for the differential equation (3.4); later we introduce a linear 
system that realises the kernel most naturally associated with Pyi- For notational simplicity, we 
often suppress the dependence of operators upon t. The following result is a consequence of results 
of Turrittin [31, 27], who clarified certain facts about the Birkhoff canonical form for matrices. 

Lemma 3.1. Let Woo = —{Wq + Wi + Wt) and suppose that the eigenvahies of Woo are =F0oo/2 
where ±9oo is not a positive integer, and let 4>o be a constant 2x1 vector. Then there exist 2x2 
complex matrices Cj for j = 1,2,..., depending upon t, such that 

oo „ 

$(x) = (/ + J]]-^)x-^°°$o i\x\>t) (3.5) 
satisfies the differential equation (3.1). 

Proof. We can define a;~^°° = exp(— M^oo loga^) as a convergent power series. By considering 
terms in the convergent Laurent series, one requires to show that there exist coefficients Cq = I 
and Cj that satisfy the recurrence relation 

Cni-Woo - nl) = -WooCn + Wl(Co + . . . + C„_i) 

+ tWt{t^-^Co + r-^Ci + . . . + C„_i), (3.6) 

where Woo + nl and Woo have no common eigenvalues. Sylvester showed that, given square 
matrices V, W and Z such that V and W have no eigenvalues in common, the matrix equation 
CV — WC = Z has a unique solution C; see [31, Lemma 1]. Hence unique C„ exist, and one shows 
by induction that ||C„|| is at most of geometric growth in n. In particular, if ||W^oo|| < Ij then the 
solution of WooCn — Cn{Woo + nl) = Dn is 

roo 

Cn = - e'^--D„e-<^--+''^Us. (3.7) 
Jo 

□ 

We have proved that (3.1) has a solution in a neighbourhood of infinity, and one can show 

that it extends to an analytic solution on the universal cover of the punctured Riemann sphere 
\ {O,l,t,oo}. (Jimbo, Miwa and Ueno [15] have shown that any (7^ solution of the pair (3.1) 
and (3.2) on R extends to a meromorphic solution on C; see [10, Remark 4.7].) 

Extending the construction of (2.2), we realise this solution via a linear system. We intro- 
duce the output space Hq = C^, then the Hilbert space Hi = ^^(i^o); t^s state space H = 
L'^{(t,oo);ds;Hi) and then let P(^) = {f £ H : sf{s) £ H}; then we choose 

bj{s) = TijI + Woor's^-'^"^- {j = 0, 1, . . .), (3.8) 
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recalling that r(^;) ^ is entire. With this choice and some convergence factor kq > 1, we introduce 
linear maps 

A: V{A)^H: f^s)^sf{s); 
Bw- P^{Kibj{s)P)f^o^ (3.9) 

C : V{A) : o - 127=0 C ^o'Cjfjis) ds. 

We prove below that e~^^P G H for all sufficiently large x. As usual, we introduce : L'^{0, oo) — > 
such that 

S./= / e-'^Bwf{s)ds (3.10) 

a; 

and the observability operator ■ -^^((0) oo); ifo) L'^{{t,oo); Hi) by 

@.f= / e-^^'c|^/(s)ds. (3.11) 

Proposition 3.2. (i) There exist ko,Xo > such that the operators &x '■ L'^{{0,oo); Hq) H 
and Ex : ^^((0, oo); i^o) H are Hilbert-Schmidt for x > Xq. 

(a) For X > xo, the hnear system {—A, Bw, Cw) reaUses the solution $ of (3.1 ), so that 

^{x;t) = Cwe-''^Bw^o- (3.12) 

(Hi) Let (f)w{x;t) = Cwe~^^Bw Then the Hankel operator on L'^{{xo,oo); Hq) with symbol 
(f)w is trace class. 

Proof, (i) We note that 9^; has kernel (e~*"KQ -'Cj)°fLo, and hence the Hilbert-Schmidt norm 
satisfies 



0x111^5 = E/ / e-'^-K^'^dsdu\\C}\\ls 



so we choose kq so that this series converges. For notational convenience, suppose that || Woo|| < 1- 
Then by the functional equation of F, we have 

Next we observe that : L^((x, oo); i^o) Li'^ii't, oo);Hi) has kernel {e~^^KQbj{u))'jLQ, and hence 
has Hilbert-Schmidt norm 



oo 

I'^xIIhs = 

j=0 

oo „oo 



E / / e-'^^Kl^\\b,in)\\lsduds 
<E/ 4'e-'^''{2u)-^b,{u)rHsdu. (3.15) 



where the tail of the series is by (3.14) 



j=2 



r(j - l)2(2x)2i 



(3.16) 



for some hw > 0. Having chosen kqj we then select xq so that the series converges for all x > xo\ 
then both and "E^ are Hilbert-Schmidt. 
(ii) Hence we can calculate 

CO /.OO 

Cwe'^'^Bw = C'je"'''^j(s) ds 

^ /"OO 

= V CjT{jI + Woo)"^ / sJ+^--ie-"^ ds 



J=0 



j=0 



(iii) By (i), the operator is trace class on L'^{{0,oo); Hq) for all x > Xq. 



(3.17) 



□ 



Furthermore, the operator = e ^^BwCwe ds on H may be represented as a kernel 
with values in a doubly infinite block matrix with 2x2 matrix entries, namely 



K^-''6j(w)Cfce-^('^+") 



u + v 



j,k=0,l, 



this generalises (2.3). Consequently one can in principle compute the kernel 

Gw(x,y) = -Cwe-^^iI-R.)-^e-y^Bw, 



(3.18) 



(3.19) 



which satisfies the Gelfand-Levitan equation 

/"OO 

Gw{x,y) + 4>w{x + y) - Gw{x,w)(pw{'w + y) dw = (t<x<y) (3.20) 

J X 



where (j)w{x;t) = Owe ^^Bw 
We also introduce 



<^j,k 



I, 



(3.21) 



_0 -Ik 

which has rank j + k and signature j — k. 

Theorem 3.3. Suppose that W^o is as in Lemma 3.1. Let $(A;t) be a bounded solution of (3.1) 
in L2((i,oo);A-^dA;R2) such that J^°° X-^\\^{X;t)fdX < oo, and let 



(J^(A;t),^(/x;t)) 
X — n 



(3.22) 



(i) Then there exists (j) G -£/^((0, oo); XdX; R^) such that 

POO 

K{\,n\t)=l {a3^s(f){X + s;t),(l){iJ, + s;t)) ds {\ ji > t\\ ^ jj). 
Jo 

and hence K deBnes a trace class operator on L'^{{t, oo);dX). 
(a) The kernel ■^K{X, fi;t) is of finite rank in {X, fi). 

Proof. Jimbo [14] has shown that the fundamental solution matrix to (3.1) satisfies 



(3.23) 



Y{x,t) = (l + 0(x-i)) 



X 



./2 











= /2 



(3.24) 



hence there exist solutions that satisfy the hypotheses. 

(i) We suppress the parameter t to simplify notation. From the differential equation (3.1), we 

have 



+ 



d \ {,mx),<i>{fi)) 



\dX djjL/ X — ji 
Now 



1^ — n 1 



i/=0,l,t 



X — u n — v 



$(A),$(/x) 



(zy = 0,1,0 



(3.25) 



(3.26) 



which have rank two and signature zero since detW^i/ = —6^ /A < 0. Hence JW^, = V^ai^iV^, for 
some 2x2 real matrix V„, and JW„ = Vjai^iV,y. Thus we find that (3.25) reduces to 



{ai,iVoMX),Vo^li)) (ai,iyi$(A),yi$(M)) {ai,iVMX),VMfi)) 



Let 



(A-l)(//-l) 



{X-t){ii-t) 



A 

yi$(A) 

A-l 
Vt$(A) 
L A-t 



(3.27) 



(3.28) 



which satisfies, after we permute the coordinates in the obvious way, 
(ffi,iK^(A),K^(/x)) 

i/=0,l,t ^ ' 



-(a3,3</>(A),0(/x)) 



fd_ d_ 
\dX ^ dn 



) {a3,3(j){X + s),(j){ii + s))ds. (3.29) 



We observe that both sides of (3.23) converge to zero as A ^ cxo and as /x ^ oo. By comparing 
the derivatives as in (3.25) and (3.29), we deduce (3.23). 

Then K = rt as sF^. We observe that the Hilbert-Schmidt norm of F^, satisfies 



ir l|2 
I-"- 4>\\hs 



< K 



{x-t)\\mrdx 

" ||$(A)f 



A 



dX 



(3.30) 
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for some k > 0, so K gives a trace class operator on L'^{t, oo). 

(ii) By a similar calculation, one can compute the derivative of K with respect to the position 
of the critical point, and find 



-{zt + et)/ut Zt + 0t/2 
zt + 0t/2 -UtZt 



$(A;i),$(/x;t) 



(3.31) 



evidently this is a finite sum of products of functions of A and functions of /x for each t. 



□ 



4. The r function associated with Painleve's equation VI 

In [2], Ablowitz and Segur derived an integral equation involving the Airy kernel for the 
solutions of Pij. Here we solve an integral equation and derive an expression for det{I — KPf^^^^^), 
which is associated with Pyi- Prom Proposition 3.2, we recall the linear system {—Aw,Bw,Cw) 
that realises ^w, and likewise we introduce a linear system {—Av,Bv,Cv) that realises = 
diagonal(I4)/a^, Vi/{x — l),Vt/{x — t)); then by considering 

{-{Av (g) / + / (g) Aw),Bv (8) Bw,Cv ® Cw) 

we introduce a new linear system that realises (f> from Theorem 3.3, so that (t>{x) = Ce~^^B. 

Next we let be the Hankel integral operator with symbol also let ^(j.) (y) = ^(y + 2x) 
and let be observability Gramian 



J X 



-'^BB^e-'^' ds = S,St . 



To take account of the signature, we introduce the the modified controllability Gramian 

/■oo 

Q^= / e-'^'c^a3,sCe-'^ds. 

J X 

We also introduce the (6 + 1) x (6 + 1) block matrices 

G{x,y) 



U{x,y) V{x,y) 
T{x,y) C{x,y) 



and 



$(x) 





ix) 



and the Gelfand-Levitan integral equation 

/•oo 

G{x,y) + <^{x + y)+ / G{x,w) * ^{w + y) dw = 

J X 

where we have introduced a special matrix product to incorporate the signature, namely 
G{x, w) * ^{w + y) dw 



(4.1) 
(4.2) 

(4.3) 
(4.4) 

(4.5) 



V{x, w)4>{w + y)^az^zdw U (x, w)(j){w + y)dw 

C(a3, y)(l){w + y)Uw T{x, w)az,z(t){w + y)dw 



(4.6) 
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Theorem 4.1. Suppose that Qx and are trace-class operators with operator norms less than 
one for all x > t. Then there exists a solution to the integral equation (4.5) such that tk{x) = 
det(7 — P(x,oo)K) satisRes 



dx 



^ogTxix) = trace G{x,x). 



Proof. By Theorem 3.3, we have K = r^as^sF^, and so 

tk{x) = det(/ - P(^_^)rJ,cr3,3r^) 
= det(/-HtG,a3,3etH.) 
= det(/ - 6,(73,361,5^4) 
= det(J-Q^L,). 

One can verify that 

U{x,y) V{x,y) 
_T{x,y) C{x,y) _ 

gives a solution to (4.6), so that 

trace C/(x,x) = trace((7 - L,Q^)-^L,e-^^^CV3,3Ce-^^) 



-trace 



Likewise we have 

C(a;, x) = trace((7 - Q^L^)-^QJe-^^B5te-^^^) 
= _trace((/-QJL,)-iQ-^). 
Adding and rearranging, we obtain 



trace G{x, x) = C,{x, x) + trace U (x, x) 



— trace 



-trace((7-L,Q-)-iL,^' 



A. 

dx 
d_ 

dx 



trace log(/ - L^Q^) 
log tk{x). 



(4.7) 



(4.8) 



(4.9) 



(4.10) 



(4.11) 



(4.12) 
□ 
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We introduce the new variable u by the elliptic integral 

then we let Z = |^ and Y = y, so {Y, Z) hes on the elhptic curve Z"^ = Y{Y — 1)(1^ — t) which 
depends upon the parameter t. Soon after his discovery of Pvi, R- Fuchs showed that if y{t) 
satisfies Pvi, then u{t) = u{y{t),t) satisfies 



-,(l-t)_ + (2t-l)- + - 



where we recognise Legendre's differential operator on the left-hand side; see [32, p 304]. By 
analysing these solutions, Guzzetti [13] obtains various series representations and bounds on the 
growth of y{t). We can analyse symbols that are elliptic functions of the second kind since their 
transfer functions have special properties. 

5. Kernels associated with the hypergeometric equation 

The Pvi equation is closely related to Gauss's hypergeometric equation [32, p 283] 

A(l - A)^ + (c - (a + 6 + 1)A)^ - a6/(A) = 0. (5.1) 
We introduce cq = c and ci = a + b — c+1, then introduce the matrix 



W{X) 



x-^°{x-i)-^^ 

-abX^"-\X-iy^-^ 



(5.2) 



so that we can express (5.1) in the form of a first order linear differential equation as in (5.4). 
For special choices of the parameters a, b, c, we can obtain a factorization of the corresponding 
kernel (5.5) which has the form of (1.2). For a separable Hilbert space H we introduce the identity 
operator Ijj and 

'Ih 
-Ih 



0'H,H 



(5.3) 



Theorem 5.1. Suppose that < c < 1 and a + b = 0, that 2\J —ab is not an integer, and that 
—ab > 5/4, and let be a bounded solution for the equation 



^ = W{XM^), (5.4) 



such that x\\'^{x)\\^dx < oo; then let 



K^^^y^^ii^MllM (x^y-x,y>l). (5.5) 
x-y 
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(i) Then there exists a separable Hilbert space H and ^ : (1, oo) H"^ such that 
J^^x\\(f>{x)\\1j2dx < oo and K = T^^<7H,H^(t> ^'^ ^^^^ ^ deSnes a trace class kernel on L^{{1 + 
6, oo); dx) for all S > 0. 

(ii) The statement of Theorem 4.1 applies to 



rx(s) = det(7- iirP(,,o,)) = det(7- ri^^^^^a^,Hr^(,,,,), 



(5.6) 



with obvious changes to notation; so ^logrK(i) is given by the diagonal of the solution of a 
Gelfand-Lcvitan equation. 

(Hi) If moreover c is rational, then K arises from a Tracy— Widom system as in (1.1). 
Proof. Let 

l/c2-2c 2c(l-c) c^-l 



/(A) 



—ab 



+ 



+ 



+ 



-1)0^ 



(5.7) 



A(A-l) 4V A2 A(A-l) (A -1)2 

which is asymptotic to {—ab — l/4)/A^ as A ^ oo. By the Liouville-Green transformation [25, 
p. 229] , we can obtain solutions to (5.1) with asymptotics of the form 



/±(A) X A-^/2(A- l)-(^-^)/2^(A)-i/4exp(±^ qix^/^ dx^ (A^oo), 



(5.8) 



and one can deduce that xf-{x)^ dx < oo. Hence there exist solutions that satisfy the hy- 
potheses. 

(i) We observe that ci + cq = 1, so < cq, ci, 1 — cq, 1 — ci < 1; we assume that < cq, ci < 1, 
as the cases of equality are easier. Evidently the functions A~'^o(A— 1)"^°"^ and A~'^^(A— 1)"^-^^ are 
operator monotone decreasing on (l,oo) in Loewner's sense and by [1, p. 577] we have an integral 
representation 



TT J_i X + U 



(5.9) 



clearly a similar representation holds for A ^^(A — 1)'^^ ^ with ci instead of cq. Hence there exist 
positive measures cJi and on [— 1 , 0] such that 



JW{x) + W{y)U 



x-y 



ab 



x-'=Hx-ir^-^-y-=Hy-ir^-'' 
x-y 







x~°o(x-l)''0'^-^~°o(y-l)°o- 
x-y 



/: 



—abuji{du) 
—ujQ (du) 



(5.10) 



-1 {x + u){y + u) 

in which —ab > 0. The matrix kernel {JW{x) + W{y)^J)/{x — y) operates as a Schur multiplier 
on the rank one tensor \E'(x) (g) ^(y) in L^{{1 + S, oo); R^); hence for each S > 0, there exists ks > 
such the Schur multiplier norm is bounded by Kg. Since '^{x + s) gives a Hilbert-Schmidt kernel, 
the operator '^{x + s) (8) ^'(y + s) ds is trace class on L^((l + d, oo);dx), and it follows that 



K 



/ , f°°/JW(x + s) + W(y + syj^, , 
{x, y) = / ( ^ ^ '—^{x + s), ^{y + s) )ds 

Jo ^ X ~ y 



(5.11) 
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is also trace class. As in Theorem 1.1 of [4], we can introduce the Hilbert space H, cf) e L^((l + 
(5, oo);xdx; H^) and the Hankel operator with symbol such that K = T^^(Th,h^cI>, so 

K{x,y)= / {aHM{x + s),(l>{y + s))H^ds (5.12) 
Jo 

where (Jh,h takes account of the fact that the Schur multiplier is positive on the top left matrix 
block and negative on the bottom right matrix block, 
(ii) We observe that 



WiX) = J 



1 
-ab 



+ 0(A-2) (lAHoo), (5.13) 



is analytic at infinity and the residue matrix has eigenvalues ±^/—ab which do not differ by a 
positive integer. Hence we can repeat the proof of Lemma 3.1 and realise the solution ^ of 
(5.4) by a linear system involving the coefficients in the Laurent series of ^. Then we can realise 
G L'^{{0, oo); iJ^) by means of a linear system {—A, B, C), where the state space is L^{{0, oo); i?^). 
We can now follow through the proof in section 4 as express r in terms of the Gelfand-Levitan 
equation. 

(iii) Let c = k/n; then {{X, Z) : Z" = X'^iX — l)""'^} gives a n-sheeted cover of P-*^, ramified 
at 0, 1, oo. On this compact Riemann surface, the functions A~'^°(A — 1)^=°"^ and \~'^^{X — iy^~^ 
are rational. 

□ 

Remarks, (i) The Painlevc equations can be expressed as Hamiltonian systems in the canonical 
variables (A, /i), where the Hamiltonian is a rational function of {X, fi); see [24] for a list. Okamoto 
[24] showed that there exists a holomorphic function r on the universal covering surface of P"^ \ 
{0,1, oc} such that Hvi{t, X{t), iJ,{t)) = ^logr(i). The methods of [11, 15, 16] involve complex 
analysis and differential geometry, and are not intended to address the operator properties of K. 

(ii) Borodin and Deift [7] have identified an integrable kernel K involving solutions 2-^1 of 
the hypergeometric equation and considered r(t) = det(/ — P(^t,oo)K)'-i they showed that a{t) = 
^ logr(i) satisfies the Jimbo-Miwa a form of Pyi- 

6. The r function associated with a Hankel operator on exponential bases 

We wish to find a more explicit expression for r and for a{t) = ^ logr(t) for suitable K, especially 
those K that factor as if = L^F^. We can obtain an explicit formula for r when ^ has the 
exponential expansion 

00 

where the coefficients lie in some Hilbert space E. In this section we establish the existence 
of such expansions by using the theory of approximation of compact Hankel operators, whereas 
in subsequent sections we consider the transfer function ^{s) of (f) and use the Mittag-Leffler 
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expansion to give explicit formulas. The Hankel operator with symbol (f) can be expressed in terms 
of the exponential basis as a relatively simple matrix, so we can derive expressions for its Predholm 
determinant. Our applications in sections 7 and 8 are to cases in which the poles lie on an arithmetic 
progression, which occurs when is a theta function or arises by a certain transformation of a 
power series. 

We suppose that Xj £ C with 3?Aj > are such that (e~*'^j)|2,i are linearly independent 
exponentials, so that 



Dn = det 



1 



N 



>0 (iV = l,2,...). (6.2) 



-Xj + Afc-I j,fc=i 

Suppose that ^ = (Cj)jli G ^'^d introduce the operators 

B : C ^ £i C £2 : a^a^ 



(6.3) 



Theorem 6.1. Suppose that is bounded and that there exist constants 5,M > such that 
SRAj > 6 and J2T=i \>^j + ^k\~^ < M for all j; let ^e£^. 

(i) Then the symbol (f){x) = Ce~^^B gives rise to a Hankel operator : L^{0, oo) —>■ L^{0, oo) 
which is trace class. 

(ii) The operator 

f'OO 

R^= e-'^BCe-'^ ds (6.4) 

J X 

on ^ is trace class, and for ji is an open neighbourhood of zero, the kernel T^{x, y) = —iJ,Ce~'^^{I + 
gives a solution to the integral equation 

T^{x,y)+fi(l){x + y)+n T^,{x,z)^{z + y) dz = Q (0 < x < y). (6.5) 

J X 

(Hi) Suppose that {I — Rt) is invertible for all t > 0. Then the Hankel operator r,^^^^ with 
kernel 4>{x + y + 2t) satisfies 

det(/-r^(^j) = exp(-^ T_r{u,u)dv}j. (6.6) 
Proof, (i) The kernel may be expressed as a sum of rank-one kernels 

CXD 

T^^Y.^je-^^^^+y^ (6.7) 

j=i 

where X^Jli l^il/^'^j converges, so F,^ is trace class. 
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(ii) By considering the rows of the matrix 



A, + A. 



we see that is also trace class. When |/Lt|||i^a;|| < 1, the kernel Tn{x,y) is well defined, and one 
verifies the identity (6.5) by substituting, 
(iii) The operators 

C:£^^C, e-*^:i^^£\ R^:£^^i^, B : C ^ (6.9) 

are all bounded, and ^ i— > is continuous from to the trace class; hence T[x,y) depends 
continuously on in a neighbourhood of in Suppose that (C*-"'')^i is a sequence of vectors 
in £^ that have only finitely many nonzero terms, and that ^ as n oo. Denoting the 

operators corresponding to ^("^ by R^^ etcetera, we can manipulate the finite matrices and deduce 
that 

rl^i^ (x, x) = ^ log det(/ - i?i")) (6.10) 

and hence 

J T[''^{x,x)dx = logdet{I-Ri''^)-logdet{I- Ri""^); (6.11) 
so letting n ^ oo, we deduce that 

^ T-i{x,x) dx = logdet(/ - Rt) - logdet(7 - R^). (6.12) 

The operator H : L^(0, oo) £?■ given by 

/"CXD 

H/= / e-'^Bf{t)dt (6.13) 

has matrix representation 



(6.14) 



■ Xj + Afe-I j,fc=i 

with respect to the standard basis (e^), and hence S is Hilbert-Schmidt since 

Yl'jLi ll'^^^jlP < oo. The operator is bounded by hypothesis, hence is also bounded; so 

Ro = is also Hilbert-Schmidt. 

The operator is trace class by (ii), and the non-zero eigenvalues of = Q^^E and Rq = 
are equal, hence 

det(7- F^^^^) = det(/ - R,) (6.15) 
which when combined with (6.12), implies that 

logdet(/-F^,^^)-logdet(/-F^,^,) = ^ T_i{u,u)du. (6.16) 
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Evidently r.^^^^ ^ as s ^ oo, and hence (6.6) follows from (6.16). 

□ 

Theorem 6.2. Let K he an integral operator on L^((0, oo); dt; C) such that: 
(i) < K < I and I — K is invertible; 

(a) there exists a separable Hilbert space E and G -^^^((0, oo);tdt; E) such that K = T^F^. 
Then K has a r-function tk and there exists a sequence {Kn)^^i of Gnite rank integral operators 
with corresponding r-functions tk„ such that: 

(1 ) Kn K in trace class norm; 

(2) tk„{x) — > tk{x) uniformly on compact sets as n ^ oo; 

(3) tk„{x) = ^1^=1 ajne~^^"^ for some ajmiJ-jn € C with ^/Uju > that are given in Propo- 
sition 6.4 below. 

Proof. (1) For ^ G {{0, oo) ; tdt; E), the operator F,^ is Hilbert-Schmidt and hence K is trace 
class. By the Adamyan-Arov-Krein theorem [26], there exists a sequence (F^(n))^i of finite-rank 
Hankel operators such that T^(„) F^ in Hilbert-Schmidt norm. 

Kronecker showed that a Hankel operator T^(,i) has finite rank if and only if the transfer 
function ^^^\s) is rational; see [26]. Hence the typical form for (j)^"'^ is a finite sum 

</.(")(t) = J^^.^^.t^e-^^* (6.17) 

where ^kj £ E and ^Xj > 0; the terms with factor t'^ give poles of order k + 1. To resolve the 
poles of order greater than one into sums of simple poles, we introduce the difference operator 
by Agg{X) = e~^{g{X + e) — g{X)), which satisfies lime^o ^sgW = g^'^K^) whenever g is A;-times 
differentiable with respect to A. By the dominated convergence theorem, 

/•oo 

/ t|A;!(-Ae)^e-^^* - i^e-^^*^ dt ^ (6.18) 
Jo 

as e ^ 0, so we can replace t^e~^i* by A;!(— Ae)'^e~'^'* at the cost of a small change in the operator 
F^(n) in Hilbert-Schmidt norm. Thus we eliminate poles of order greater than one, and we can 
ensure that < fJ^(„,F^(„) < /, with / - F^(„)F^(„) invertible. Let = F^(„)F^(„) so that 
has finite rank and Kn — > -fT as in trace norm as n — ^ oo. 

(2) Let 0(,)(t) = 0(t + 2x) and (/)j^}(t) = (t>^^\t + 2x). We have r^(„)F_^(„) F^^^^F^^^, in 

trace class norm as n ^ oo so 



r(x) = det(7-iCP(,,oo)) 
= det(7-Ft^^^F,^^, 

= i^det(/-Ft^(,,F^(„ 
= lim TK„{x) 



(6.19) 
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since the Predholm determinant is a continuous functional on the trace class operators. 

(3) To calculate the function tk„{x) in (3) of Theorem 6.2, we assume that ^^"^ has the form 



N 



it>0) 



(6.20) 



where G E and 3ffAj > 0. Without loss of generality we can replace E by the subspace span(^j)j^]^ 
and for notational simplicity we take G Mi^^(C) where u < N. 

We introduce 



and 



column 



- Xj + Afc 



Afe + Ari 



AT 



k=l 



e M,jv,i(C). 



Lemma 6.3. The matrix 



K — [aj^m]j^m=l 



represents the operator r\„^T ^(„) with respect to the (non-orthogonal) basis (e ^^^)jL-^. 
Proof. We observe that the transfer function of is the rational function 



j = l J 



The operator r^(^)r^(n) has kernel in the variables 



/"OC 

/ (2a; + s + u),(/)("H2x + i + 'u))du 

Jo 



and hence one computes 



('^j +Afc)(Afc + A„) 
Recalling the definitions (6.21) and (6.22), one computes 

O-j^m — / ^ 
3- 



(Aj + Afc)(Afc + A 

m) 

and by comparing this with (6.23), one obtains the stated identity. 



(6.21) 

(6.22) 
□ 

(6.23) 



(6.24) 



(6.25) 



(6.26) 



(6.27) 



□ 
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We can proceed to compute the r function when (f)^'^'> is as in Theorem 6.2. For 5, T C {1, . . . , N}, 
let Ks,K be the submatrix of Kn that is indexed by (j, k) e S x T, and let (15 be the number of 
elements of S. 

Proposition 6.4. (i) Suppose that : (0,oo) C is as in (6.20). Then 

N 



1 



An + At 



jes,keT 



(6.28) 



(a) Suppose that (j)^'^^ : (0, oo) E where E has orthonormal basis (er)J^=i and let ^j^^ 
i^ji^r)- Then 



S,T:ttS'=ttT 



dct 



A, +Afc ijeS;{k,r)eT I Am + Afc imeS;{k,r)eT 



(6.29) 



and the sum is over all pairs of subsets 5 C {1, . . . , N} and T C {1, . . . , A^} x {1, . . . ,u} that have 
equal cardinality. 

Proof, (i) By the Lemma we have tk„{x) = det(I — K^), and by expansion of the determinant 
we have 

det(7-i^:„)= E i-l)^^detKs,s (6.30) 



where det K^^^ = 1 and otherwise 



S:SQ{1,...,N} 



det Kss = det [ V , - , , 

L;^i(A, + Afc)(Afc + A^) 



j,meS 



(6.31) 



which reduces by the Cauchy-Binet formula to 

det^^-_ det|^^ 
T-4T=iS + ^'^ •'■^•5''=^'^ L Afc + A, 



k€T,meS 



(6.32) 



E (n ^^^'""'^ n 

r:tiT=ji5 jes keT 



\ 1 1 




\ 1 1 


det 


-Xj + Afc . 


■ Am + Afc - 


jes,keT 



meS,keT 



By taking the sums over both S and T, we obtain the stated formula. 

(ii) To prove (ii) one follows a similar route until line (6.32), except that we have = 
Ylr=i ^j^^^k"^ ' the indices in the Cauchy-Binet formula are over the product set T C {!,..., A'"} x 
{!,..., 4. 

□ 

7. The r function for the hard spectral edge 

Our first application of section 6 is to the hard edge ensemble. The Jacobi polynomials arise when 
one applies the Gram-Schmidt process to {x'^)'^q with respect to the weight (1 — x)"{l + x)^ 
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on [—1, 1] for Q!,/3 > —1. The zeros of the polynomials of high degree tend to accumulate at the 
so-called hard edges 1— and (—1)+. According to [28], the kernel that describes the limiting 
behaviour of the joint distribution of the scaled zeros near to the hard edges is given by 



[ Ju{2^/ti)J,{2^)dt (7.1) 
Jo 



x-y 

on L^((0, 1); df): here J,j is Bessel's function of the first kind of order v. Hence we change variables 
and introduce the Hankel operators on L^((0, oo); dt). 

Proposition 7.1. For u > —1, let (f){x) = e~^/^ J,y(2e~^/^) and let be the Hankel integral 
operator on L^(0, oo) with symbol 0. Tiien Theorem 6.2 applies to F,^. 

Proof. Prom the power series for J^, we obtain a rapidly convergent series 



n=0 ^ ' 



(7.2) 



giving a meromorphic transfer function 



^ n!r(zy + n+l)(s + n + (z/ + l)/2)' ^^'^^ 



n=0 



for which the poles form an arithmetic progression along the negative real axis. One can alterna- 
tively express <^ in terms of Lommel's functions. 

We choose A„ = (2n-|-i/-|- l)/2, so (A„) gives an arithmetic progression along the positive real 
axis, starting at [y -\- l)/2 > 0, and Y^=q < The operator Q : P —>■ L^(0, oo) is bounded 
by duality since 



/•oo ^ 



'dx= 



n=0 n,m—0 



<cJ2K\' (7.4) 



n=0 



by Hilbert's inequality. Hence is a self-adjoint trace class operator, and Theorem 6.2 apphes. 

We can now compute some of the finite determinants that appear in the expansion of det(/ — 
^ ) from Proposition 6.4. 

Definition (Partition). By a partition A we mean a list ni > n2 > . . . > of positive integers, so 
that the sum |A| = Yfj=i is split into £ = i{X) parts. For each A, the symmetric group on |A| 
letters has an irreducible unitary representation on a complex inner product space 5a, known as 
the Specht module. For notational convenience, we introduce a null partition with ^(0) = and 
write dim(S'0) = 1. 
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Proposition 7.2. Suppose that u = 0. Let K = r'^ and t{x) = trace(7 — KP^^ ,^^). Then K is a 
trace class operator on -L^(0, oo) such that < K < I and 



r{x) = 



dim(5; 



g-2|A|x 



(7.5) 



where the sum is over all partitions. 

Proof. Let = span{e~(^-'+''+^)^ : j = 0, . . . ,n} and let Qn : -L^(0, oo) En be the orthogonal 
projection; likewise we introduce the closure E^o of the subspace U^^E'^ and the corresponding 
orthogonal projection Qoo '■ -£'^(0, oo) — >■ E^o- Observe that Qn Qoo in the strong operator 
topology as n ^ oo and that T^^^^Qoo = Qoor</,(^,; hence det(/ - T^^^^) = lim„^oo det(/ - 

The matrix of Qn^\^^Qn with respect to (e-^^J+'^+i)*)^^^ satisfies 



-^y+m^-2x{j+m+v+l) 

V+l) ^ 



L j!m!r(i/ + J + l)r(m + z/+l)'^(j + A; + z/ + l)(m + A; + r/ + 1) J j,m=o 



(7.6) 



We observe that the corresponding infinite matrix for Qoor^^ j has entries that summable with 
respect to j and m over j, m = 0, 1, . . . ; thus det(/ — F^^ ^ ) is a determinant of Hill's type. 

We consider the determinant in (6.28). We change notation so as to allow the running indices 
in sums to be j, A; = 0, 1, . . . , and we let S and T be subsets of {0, 1,2,.. .} that are finite and of 
equal cardinality. Suppose that the elements of S are mi > m2 > . . . > m^, while the elements of 
T are ki > k2 > ■ ■ ■ > kf, next let A'^ = ^ + X]i=i("^i + ^i)- Then in Frobenius's coordinates [8, 
21], there is a partition A {mi, . . . , mf, ki, . . . , ki) with |A| with a corresponding Specht module 
Sx such that 

rifcer^! dim(-SA) 



det 



(7.7) 



-m!F(m + l)(m + k + l)imes,keTYl^^s m\ (|A|)! 

as in the hook length formula of representation theory; see in [21]. Hence the pair of sets S and 
r, each with ^(A) elements give rise to the product of determinants 



det 



det 



Lj!F(j + + k + l)i jeS,keT Lm!F(m + l)(m + A: + 1) 
and the exponential 



^es,keT 



dim(5'>, 



n2 



^ (2j + l)x-^ (2fc+l)a 



-2|A|x 



(7.8) 



(7.9) 



Conversely, each partition A of some positive integer gives a Ferrers diagram and we can 
introduce subsets S,T C {0, 1, . . .} that are finite and of equal cardinality which gives a contribution 
to the sum (6.28) from the prescription of (7.9) and (7.10). By summing over all partitions, or 
equivalently all pairs of sets S and T, we obtain the series (7.6). 

□ 



22 



Remark. Borodin, Okounkov and Olshanski [8] have computed a Predholm determinant for the 
discrete Bessel kernel, and derived a result vaguely similar to (7.6). The determinant det(7 — 

-^-P(o,s)) was computed by Forrester, and Forrester and Wittc have considered various circular 
ensembles [11]. Basor and Ehrhardt have considered asymptotics of Bessel operators [3]. 

8. A r function related to Lame's equation 

To conclude this paper, we consider Hankel operators related to Lame's equation. First we 
review some ideas that originate with Hochstadt and are developed by McKean and van Moerbecke 
in [23]. 

Let £■ be a compact Riemann surface of genus g, and J the Jacobi variety of £, which we 
identiiy with C'^/L for some lattice L in C^. An abelian function is a locally rational function 
on J, or equivalently a periodic meromorphic function on with 2g complex periods. A theta 
function (or elliptic function of the second kind) 9 : C ^ with respect to L is a meromorphic 
function, not identically zero, such that there exists a linear map x ^ L{x, u) for x G and 
u eL and a function r? : L ^ C such that e{x + u) = 6)(a;)e2'^^(^(^'")+''(")) for all x e and 
It G L. The pair (L, ry) is called the type of 9, as in [20]. 

Suppose that g : R — >^ R is infinitely diflferentiable and periodic with period one. Let U\ be 
the fundamental solution matrix for Hill's equation 

-^f + Q{t)f{t) = \f{t) (8.1) 

so that U\{0) = I, and let A(A) = trace C/a(1) be the discriminant. Suppose in particular that A 
lies inside the Bloch spectrum of —■^ + q{t), but that 4 — A(A)^ ^ 0. Then any nontrivial solution 
of (8.1) is bounded but not periodic. 

We suppose that 4 — A(A)^ has only finitely many simple zeros < Aq^'' < A^^^* < . . . < , 

(2) 

and let A^ be double zeros for k = 1,2,...; then 

2.1? , oo \ 2 

4-A(A)^=c,n(i--^)n(i-T^) • M 

j=0 k=l H 

Proposition 8.1. Suppose that q is a finite gap potential so that the discriminant has this form. 
Then Hill's equation gives a Tracy-Widom system on a hyperelliptic curve of genus g. 

Proof. The equation (8.1) has nontrivial bounded solutions if and only if |A(A)| < 2, so that A 
lies in an interval of stability. Hence the spectrum of — ^ + g in L^(R) has the form 

[xi'\\['^]u[xi'\xi'^]u...u[\g\^). (8.3) 

The zeros of A' (A) consist of all the Aj, together with zeros Xj that interlace the simple zeros of 
4 - A(A)2, so Xi^)_^ < X'j < Xi^j> for j = l,...,g; hence 

(8.4) 



A' (A) nf=i(i-A7 
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We introduce the hyperelliptic curve 



3=0 ' \ 

which has genus g. We introduce a new variable by the integral 

^'{X)dX 



n(l-T(T))' (8-5) 



(8.6) 



so that 2 cost = A(X), then we invert this relation by introducing a hyperelliptic function Q{t) 
with local inverse R so that R{Q{t)) = t and 2 cost = A{Q{t)). After a little reduction, Hill's 
equation becomes 

Now by [23, p. 260], q{R{X)) is an abelian function on £ and may be viewed as a locally rational 
function on the Jacobian variety J over £; hence we can express (8.7) as a matrix diflFerential 
equation with coefficients in the field of locally rational functions on J. 

□ 

Suppose in particular that q is elliptic with periods 2K and 2K'i where K, K' > 0. Gesztesy 
and Weikard [12] have shown that the spectrum has only finitely many gaps if and only if 2; U\{z) 
is meromorphic (and possibly multivalued) for all A G C. By a classical result of Picard, there 
exists a nonsingular matrix Ax such that U\{z + 2K) = U\{z)A\. If A\ has distinct eigenvalues, 
then there exists a solution / to (8.1) that is a theta function with respect to the lattice L = 
{2Km + 2K'in ■.m,ne Z}. 

Next we describe in more detail the case of genus one. We recall Jacobi's sinus amplitudinus 
of modulus k is sn(a; | k) = smijj where 

x= / , (8.8) 
Jo VI - A;2 sin^ 9 

For < A; < 1, let -fC(/c) be the complete elliptic integral 

K{k) = / . . ; (8.9) 

Jo VI - /c2 sin^ t 

next let K'{k) = K{-\/l — k"^); then sn{z \ kY has real period K and complex period 2iK' . We 
introduce 

(61,62,63) = (—^,—^, (8.10) 

^"^^ 4(fc4_fc2 + l) 4(fc2-2)(2P-l)(fc2 + l) ^^^^^ 
92 = ^ , 93 = ^ ; (8.11) 
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then let Weierstrass's function be 



V{z) = e3 + {e,-e2){sn{z\k)) \ (8.12) 

Likewise, V{z) has periods 2K and 2iK' , and V{x + iK') is bounded, real and 2i^-periodic. In 
terms of the new variable x = z + iK' and the constant B = — A(ei — 62) — ^(^ + 1)63, Lame's 
differential equation (1.16) transforms to 

\--^+ + l)'P{x)j<^{x) + B<i>{x) = 0. (8.13) 
Writing X = V{x),Y = V{y) and Z = V{x), the point {X, Z) lies on the elliptic curve 

S: Z^ = iiX - ei)iX - e2){X - 63) (8.14) 

and the elliptic function field K consists of the field of rational functions of X with Z adjoined 
and we think of i? as a point on £. For (xq, zq) on £, we introduce the function 

^{X,Z;xo,Zo) = eUl f (8.15) 
\2 X -xo z J 

which takes multiple values depending upon the path 7 from (xq, zq) to (X, Z). Then for integers 
^ > 1, and typical values of S, there exist k G C and polynomials ^o(-'^) and A\{X) such that 

^{X) = (^Ao{X) + A,{X) (1±^)) $(X, Z; xo, zo) exp(At ^) (8.16) 

gives a solution of 

- (^^) '*(^) + ^(^ + 1)^*(^) + B<I>{X) = 0, (8.17) 

known as a Hermite-Halphen solution. Maier [22, Theorem 4.1] has shown how to compute (xq, yo) 
and the spectral curve in terms of k and B, thus making (8.17) convenient for computation. As Z 
is rational on the elliptic curve. Lame's equation gives rise to a Tracy-Widom system (1.1) that 
closely resembles the Laguerre system of orthogonal polynomials with parameter one, as considered 
in [5, 29]. 

Suppose henceforth that i = 1. For A G [k^,l] U [k^ + l,oo), all solutions to (1.16) are 
bounded; however, except for the countable subset of values of A that gives the periodic spectrum, 
these solutions are not K or 2K periodic; see [22]. Write B = V{a) where a is the spectral 
parameter. Weierstrass introduced the functions 

<'W-n(i-3«K^5(S)') 

where L* = L \ {(0,0)}, and C,{z) = a'{z)/a{z) so that V = Then by [19, (13)] the equation 
(8.13) has a nontrivial solution 

*(x;a) = -^i^eC(")- (8.19) 
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such that ^(x; q;)\E'(— x; a) = Via) — V{x) and a ^ '^{x\ a) is doubly periodic. 

The solutions give rise to a natural kernel, for after we make the local change of independent 
variable x^ X and write f{X) = ^(x;q:) and g{X) = "<if'{x;a), we have by [19, (18)] 

+ (8.20) 

X — Y 

The right-hand side has the shape of the kernel of Hankel integral operator. In the remainder of 
this section we introduce this operator, and compute the corresponding Predholm determinant. 

Lemma 8.2. Let P = —2K({a)+aC(a+2K) — aC{a), suppose that > andlett G C such that 
'^{x + 2t; a) is analytic for x £ [0, 2K]. Let (x) = ^(x + 2t; a) and h{s) = J^^ e"*'"0(t)(«) du. 
Then (pi^t) 3. theta function and has an exponential expansion 

^«(-)= E ^/.(^^^^)e-(«)/(-) (x>0) (8.21) 



m=— oo 



and <j){t) is a meromorphic function with poles in an arithmetic progression. 

Proof. We introduce rj = ({a + 2K) — ({a) and r]' = ("(a; + 2iK') — C(q^)- Then o" is a theta 
function and satisfies a simple functional equation given in [20, p. 109]; from this we deduce that 
^ is also a theta function and satisfies the functional equations 

*(x + 2i<C;a) = ^{x-a)e'^^^^°'^-"'' , *(x + 2iK';a) = ^{x;a)e^'^''^^''^-°"'' . (8.22) 

Hence x i— \Ef(x + 2f; a) is of exponential decay as x — >■ oo through real values. 
Due to (8.22), the transfer function of ^(t){x) is 



<^(j) (s) = V / e-*"*(^i + 2t; a) du 

= (1 - e-2-f^«+2^C(«)-«^)-i / -^(u + 2t; a)e-*" du (8.23) 

Jo 

which is meromorphic with possible poles at the points s = {2K)~^{2KC,{a) — arj + 2'Kmi) for 
m G Z which form a vertical arithmetic progression in the left half plane. The position of the poles 
is determined by the type of the theta function. 

We can deduce the exponential expansion by inverting the Laplace transform. Let T = 
{2m + l)Tr/{2K) let x > and consider the contour [—iT,iT] © St, where St is the semicircular 
arc in the left half plane with centre that goes from —iT to iT; then by Cauchy's Residue Theorem 
we have 



St J[-iT,iT] „_ ™ \ IK / 



n=—m 
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We integrate J^^ '^{u + 2t; a)e du by parts and write 

sx p 2.K" 

^"^(*)(^) = s{l-%^^-0) + ^W(O) + I e"'"'^(t)(^) du) (8.25) 

and then use Jordan's Lemma to show that /^^ e*^0(t)(s) ^ as T ^ oo. Hence 

□ 

Theorem 8.3. Let 4>i^t){x) = ^(x + 2t; a) and let F^^^j be the Hankel integral operator on L^{0, oo) 
with symbol (t>{t)- Then the conclusions of Theorem 6.1 hold for r^j^^. 

Proof. Let = (27rin + /?)/ (2-fir) where > 0. Then by a standard argument from the calculus 
of residues, we have 

^ 1 K-^SRcoth^ , 

S ^JTaTp = e Z). (8.27) 

/C = — CXD ' 

The operator : -L^(0, oo) £^ given by 

f^fre-~^^^f{s)dsY (8.28) 

VO /j=-oo 

is bounded. Indeed, we observe that the sequence (e~^"^)^_(^ forms a Riesz basic sequence in 
L^(0, oo), in the sense that there exists a constant C > such that 

^ E - / I E "n^"^"'' < C ^ |a„p (8.29) 



c- 

n=—oo " ^ n=—oo 

for all (a,„) G i?^. To prove this, one uses a simple scaling argument and orthogonality of the 
sequence 

(g27rmx)oo^_^ in L^[0, 1]. In particular, this shows that @^ : ^ L'^{0, oo) is bounded, 
so is bounded. 

We can now use the general Theorem 6.1. Given this rapid decay and the fact that '^{x + y + 
2t; a) is analytic, one can easily check that r^^^^ is trace class. 

□ 

Our final result gives the order of growth of the determinant 



Dn = det 



1 



N 



(8.30) 

j,k=l 



Proposition 8.4. Suppose that Xj = (27rij + (3)/{2K) where > and K > 0. Let ji be the 
Haar probability measure on the unitary group U (N), and let arg e^^ = 9 for < 9 < 27r. 
(i) Then 

^ \l ^2^j J trace arg i7j/x(dC/). (8.31) 



'U{N) 
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(a) There exists a constant c > such that 

VsinhSR/?/ Vsinh5ft/3/ 



so 



d]I^ Kcosech^lS (N^oo). (8.33) 

Proof, (i) Let 



u 



/(^) = 1 _ ^-2m (0 < ^ < 1) (8-34) 
and let the Fourier coefficients of / be afc = f{u)e~^^'^'^'"du, which we compute and find 

1 



a,_fc. (8.35) 



Then we can use an identity due to Heine, and express the Toeplitz determinant of [flj-fc] as an 
integral 

1 r ^ 

det[a,_fc],- fc=i,...,Ar = ^ / TT {e^""''' - e^'^'^'l^ U fiOj) dO^ . . . dON, (8.36) 

which we regard as an integral over the maximal torus in U{N), and hence we convert the expression 
into an integral over the group U{N), obtaining 



det 



A,- + Afc 



= / exp|tracelog/(arg;7/(27r))|//((ii7). (8.37) 

j,k=l Ju{N) ^ 



(ii) Note that log/(arge*V(2^)) = log(2i^/(l - e'^^'^)) - ^P0/tt. Let U G U{N) have 
eigenvalues e*^^, . . . , e*^'' where < di < ■ ■ ■ < On < 27r; then the expression 

trace arg - ttAT = 6*1 + . . . + 6'jv - A^vr (8.38) 

satisfies a central limit theorem, but we need to adjust the functions slightly to accommodate the 
discontinuity of arg. Let ^fi, 52 : R ^ R be Lipschitz functions with Lipschitz constant L, that are 
periodic with period 27r, and satisiy gi{0) < < 92(0) ior < < 27r, and 

7r--< gi{9)de< g2{G)de <!:+-. (8.39) 



By Szego's asymptotic formula [18], there exists a constant c such that 

'U{N) ^ ^ JU{N) 



I exp(-^ j;e,)M(dt/)< / exp(-^X^5i(^.))M(dt^) 

<e^p(^-N^pJ g^{e)— + c{^pfL^y (8.40) 
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hence we have an upper bound on Djv of 



Using g2 instead of gi, one can hkewise obtain a lower bound on Dm- To conclude the proof, we 
choose L = 7Vi/3(2cSR/3)-i/3. 

□ 
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